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© A highly efficient coding/decoding by subjecting image signals to orthogonal transformation, by which all 
data of interlace images, inclusive of scarce and rich types of images in motions and even a mixed type thereof, 
can be coded efficiently. A circuit (19) senses motion vectors in every macro-block between an odd-numbered 
field and an even-numbered field. A circuit (21) determines the coding mode (coding of every field or coding of 
every frame), according to the median of the motion vectors. A control circuit (16) controls gates (15, 17) and 
switches (6, 9, 10, 15) corresponding to the determined coding mode, and it generates a predictive image of 
every field or frame from buffer memories (7, 8). Circuits from a difference circuit (22) to a VLC circuit (25) 
calculate the difference data between an image to be coded and the predictive picture thereof, subject the 
difference data to discrete cosine transformation, and thereafter perform variable-length coding. Also, the VLC- 
circuit (25) sets the coding mode as a flag in the header of the predetermined hierarchy of a bit stream. 
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TECHNICAL FIELD 

This invention relates to an encoding method and an encoding device for high efficiency encoding of 
picture signals by orthogonal transform, a picture data decoding method and a picture data decoding device 
5 for decoding picture data resulting from high efficiency encoding, and a picture recording medium. 

BACKGROUND ART 

According to a draft for standardization for the high efficiency encoding system for picture signals, as 
10 proposed by the Moving Picture Experts Group (MPEG), a high efficiency encoding system for picture 
signals for a so-called digital storage medium is prescribed. The following is the principle of the high 
efficiency encoding system by MPEG. 

That is, with this high efficiency encoding system, a difference is first taken between pictures to lower 
the redundancy along the time scale. Subsequently, discrete cosine transform (DCT) and variable length 
is coding (VLC) are carried out to lower the redundancy along the spatial axis. 
The redundancy along the time scale is first explained. 

In general, in consecutive moving pictures, a picture under consideration, that is a picture at a given 
time point, bears strong similarity to temporally previous and temporally succeeding pictures. Consequently, 
by taking a difference between a picture now to be encoded and a temporally forward picture, and by 

20 transmitting the difference, as shown in Fig.1, it becomes possible to diminish the redundancy along the 
time scale and hence the amount of the information to be transmitted. The picture encoded in this manner 
is termed a predictive-coded picture, P-picture or a P-frame, as later explained. 

Similarly, by taking a difference between a picture now to be encoded and a temporally forward picture, 
a temporally backward picture or a interpolated picture produced from the temporally forward and 

25 temporally backward pictures, and transmitting the smallest of the differences, it becomes possible to 
diminish the redundancy along the time scale and hence the amount of the information to be transmitted. 
The picture encoded in this manner is termed a bidirectionally predictive-coded picture, B-picture or a B- 
frame, as later explained. In Fig.1, a picture indicated by I is an intra-coded picture as later explained, while 
pictures indicated by P and B in the figure are the above-mentioned P-picture and the B-picture, 

30 respectively. 

For producing prediction pictures, so-called motion compensation is performed. According to the motion 
compensation, a 16 x 16 pixel block, referred to herein as a macro-block, made up of unit blocks each 
consisting of 8 x 8 pixels, is prepared, one of those macro-blocks of the previous picture which is in the 
vicinity of a macro-block under consideration and has the smallest of the differences is retrieved and a 

35 difference between the macro-block under consideration and the macro-block thus retrieved is taken to 
diminish the volume of data to be transmitted. For example, with the above-mentioned predictive-coded 
picture or P-picture, one of picture data produced by taking a difference between the prediction picture and 
the motion-compensated prediction picture and picture data produced by not taking a difference between 
the prediction picture and the motion-compensated prediction picture, whichever is smaller in data volume, 

40 is selected and encoded on the basis of the 16 x 16 pixel macro-block as a unit. 

However, in such case, a larger amount of data need to be transmitted for a picture portion which has 
appeared from behind a moving object. In this consideration, with the above-mentioned bidirectionally 
coded picture or B-picture, one of picture data corresponding to the difference between the picture data 
now to be encoded and the decoded and motion-compensated temporally forward picture data, picture data 

45 corresponding to the difference between the picture data now to be encoded and the decoded and motion- 
compensated temporally backward picture data, picture data corresponding to the difference between the 
picture data now to be encoded and interpolated picture data prepared by adding the decoded and motion- 
compensated temporally backward and temporally forward picture data and the picture data for which the 
difference has not been taken, that is the picture now to be encoded, whichever has the smallest data 

so volume, is encoded. 

The redundancy along the spatial axis is .hereinafter explained. 

The difference of the picture data is not transmitted directly, but is processed with discrete cosine 
transform (DCT) from one 8x8 pixel unit block to another. The DCT represents a picture depending on 
which frequency components of a cosine function are contained in a picture and in which amounts these 
55 frequency components are contained, instead of on the pixel level. For example, by two-dimensional DCT, 
picture data of the 8 x 8 unit block is transformed into a 8 x 8 coefficient block of the components of the 
cosine function. For example, picture signals of a natural scene as imaged by a television camera 
frequently represent smooth signals. In such case, the picture data volume may be efficiently diminished by 
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processing the picture signals with DCT. 

The data structure handled by the above-mentioned encoding system is shown in Fig.2. The data 
structure shown in Fig.2 includes, from the lower end on, a block layer, a macro-block layer, a slice layer, a 
picture layer, a group-of-picture (GOP) layer and a video sequence layer. The data structure is now 
5 explained, from the lower layer on, by referring to Fig.2. 

First, as to the block layer, each block of the block layer is composed of 8 x 8 neighboring pixels, that 
is 8 pixels of 8 lines, of luminance or color difference. The above-mentioned DCT is performed for each of 
these unit blocks. 

The macro-blocks of the macro-block layer are made up of left and right upper and lower four 

w neighboring luminance blocks or unit luminance blocks YO, Y1, Y2 and Y3 and color difference blocks or 
unit color difference blocks Cr, Cb, which are at the same positions on the picture as the luminance blocks, 
as shown at E in Fig.2. These blocks are transmitted in the sequence of YO, Y1 , Y2, Y3, Cr and Cb. Which 
picture is used as a prediction picture, that is a reference picture of difference taking, or whether or not a 
difference need not be transmitted, is decided on the macro-block basis. 

75 The above-mentioned slice layer is made up of one or more macro-blocks arrayed in the picture 
scanning sequence, as shown at D in Fig.2. At a header of the slice, the difference of the dc component 
and the motion vector in the picture are reset. On the other hand, the first macro-block has data indicating 
the position within the picture, such that reversion may be made in case of an error occurrence. 
Consequently, the length or the starting position of the slice are arbitrary and may be changed depending 

20 on the error state on the transmission channel. 

As to the picture layer, each picture is made up of at least one or plural slice(s), as shown at C in Fig.2. 
Each picture may be classified into the intra-coded picture (l-picture or l-frame), the predictive-coded 
picture (P-picture or P-frame), bidirectionally coded picture (B-picture or B-frame) and the DC intra-coded 
picture (DC coded (D) picture). 

25 It is noted that, for encoding the intra-coded picture or l-picture, only the information which is closed 

within each picture is employed. In other words, for decoding the l-picture, only the information contained in 
the picture concerned is employed. In effect, or encoding a picture by intra-coding, the picture is directly 
discrete cosine transformed without taking a difference. Although this encoding system usually has a poor 
efficiency, random accessing or high-speed reproduction may be enabled by inserting this picture at 

30 arbitrary places. 

As to the predictive-coded picture (P-picture), the l-picture or the P-picture positioned temporally 
previously at an input and already decoded is employed as a prediction picture (reference picture in 
difference taking). In effect, encoding the difference between the prediction picture and the motion- 
compensated prediction picture or directly encoding the prediction picture, that is without taking the 

35 difference, whichever is more efficient, is selected on the macro-block basis. 

As to the bidirectionally coded picture or B-picture, three types of pictures, namely a temporally 
previously positioned and already decoded l-picture, a temporally previously positioned and already 
decoded P-picture and an interpolated picture obtained from these pictures, are employed as a prediction 
picture. In this manner, encoding of the difference between the prediction picture and the motion- 

40 compensated picture and the intra-coding, whichever is more efficient, may be selected on the macro-block 
basis. 

The DC intra coded picture is the intra-coded picture which is made up only of DC coefficients in DCT 
and which cannot exist in the same sequence as the remaining three pictures. 

The GOP layer is made up of one or plural l-picture(s) and zero or plural non-l-pictures, as shown at B 
45 in Fig.2. The distance between the l-pictures, such as 9, or the distance between the l-pictures or the B- 
pictures, such as 3, is arbitrary. Besides, the distance between the l-pictures or between the B-pictures may 
be changed within the inside of the GOP layer. 

The video sequence layer is made up of one or plural GOP layer(s) having the same picture size or the 
same picture rate, as shown at A in Fig.2. 
so For transmitting the moving picture standardized in accordance with the high efficiency encoding 

system by MPEG, as described above, picture data produced by compressing a picture in itself are 
transmitted, and subsequently a difference between the picture and the motion-compensated same picture 
is transmitted. 

However, the following problem has been found to be raised when the picture to be encoded is an 
55 interlaced picture resulting from an interlaced scanning. 

That is, if a picture resulting from the interlaced scanning is encoded on the field-by-field basis, a 
difference in the vertical positions is alternately incurred from field to field. Consequently, when transmitting 
a stationary portion of a moving picture, difference data is produced at a boundary between the fields, 
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notwithstanding that the picture portion remains stationary. Since the difference data needs be transmitted, 
the encoding efficiency is lowered at the stationary portion of the moving picture. 

Also, if a picture produced by interlaced scanning is encoded on the field-by-field basis, since each 
block is formed on the field-by-field basis, the interval between pictures becomes broader than if the block 
5 is formed on the frame-by-frame basis, with the result that correlation and hence the coding efficiency are 
lowered. 

On the other hand, if the picture resulting from interlaced scanning is encoded on the frame-by-frame 
basis, the moving portion in the frame is blurred in the shape of a comb. For example, if a moving object, 
such as a motor vehicle, is present ahead of a stationary object, the motor vehicle, which is the moving 
io portion, becomes blurred when viewed as a frame, as indicated at KS in Fig. 4, because of motion between 
fields. The result is that high-frequency components, not present in the original picture, are transmitted, thus 
lowering the encoding efficiency. 

Besides, with the frame-by-frame encoding, since encoding is made on the basis of two consecutive 
fields making up a frame as a unit, predictive coding cannot be employed between the two consecutive 
is fields. Thus the minimum distance of predictive coding becomes a frame or two fields. Consequently, as 
compared to the field-by-field coding with the minimum predictive coding distance of one field, the frame- 
by-frame encoding is disadvantageous in respect to a picture having a fast or intricate motion. 

As discussed in the foregoing, there are occasions wherein the field-by-field encoding is lowered in 
encoding efficiency with corresponding rise in encoding efficiency of the frame-by-frame encoding, or 
20 wherein the frame-by-frame encoding is lowered in encoding efficiency with corresponding rise in encoding 
efficiency of the field-by-field encoding. 

In view of the above-described status of the art, it is an object of the present invention to provide a 
picture data encoding method and a picture data encoding device whereby a picture produced by 
interlaced scanning may be encoded efficiently whether the picture is replete with motion, the picture shows 
25 only little motion or the picture replete with motion and the picture showing only little motion co-exist, and a 
picture data decoding method and a picture data decoding device for decoding picture data encoded by the 
encoding method and the encoding device. 

DISCLOSURE OF THE INVENTION 

30 

A first picture data encoding method for encoding interlaced picture signals according to the present 
invention comprises deciding if encoding of picture signals is to be executed on the field-by-field basis or 
on the frame-by-frame basis, encoding the picture signals on the field-by-field basis or on the frame-by- 
frame basis, depending on the results of decision, for generating encoded picture data, and appending 
35 discrimination data to the encoded picture data based on the results of decision, the discrimination data 
indicating if the encoded picture data have been encoded on the field-by-field basis or on the frame-by- 
frame basis. 

According to a second picture data encoding method for encoding interlaced picture signals according 
to the present invention, encoded picture data has a hierarchical structure and the discriminating data is 
40 provided at a portion of a header of a predetermined hierarchical layer of the encoded picture data. 

According to a third picture data encoding method for encoding interlaced picture signals according to 
the present invention, the decision in the first picture data encoding method is executed based on the 
motion vector of each macro-block. 

A fourth picture data encoding method for encoding interlaced picture signals according to the present 
45 invention comprises encoding picture signals on the field-by-field basis for generating encoded picture data, 
and appending discrimination data indicating that the encoded picture data have been encoded on the field- 
by-field basis to the encoded picture data. 

According to a fifth picture data encoding method for encoding picture signals according to the present 
invention, encoded picture data has a hierarchical structure in the fourth picture data encoding method and 
so the discriminating data is provided at a portion of a header of a predetermined hierarchical layer of the 
encoded picture data. 

A sixth picture data encoding method for encoding interlaced picture signals according to the present 
invention comprises encoding the picture signals on the frame-by-frame basis for generating encoded 
picture data, and appending discrimination data indicating that the encoded picture data have been encoded 
55 on the frame-by-frame basis to said encoded picture data. 

According to a seventh picture data encoding method for encoding picture signals according to the 
present invention, encoded picture data has a hierarchical structure in the sixth picture data encoding 
method, and the discriminating data is provided at a portion of a header of a predetermined hierarchical 
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layer of the encoded picture data. 

A first picture data decoding method for decoding picture data encoded with a block consisting in a 
two-dimensional array of plural pixels as an encoding unit comprises detecting a flag provided at a portion 
of a header for the picture data for discriminating if the picture data have been encoded on the field-by-field 
5 basis or on the frame-by-frame basis, and adaptively switching between field-based decoding and frame- 
based decoding based on the flag. 

According to a second picture data decoding method according to the present invention, picture data 
has a hierarchical structure, in the first picture data decoding method, the flag is detected from a header of 
a predetermined hierarchical layer of the picture data, and switching is adaptively made between field- 
io based decoding and frame-based decoding for each of predetermined hierarchical layers based on the flag. 

A third picture data decoding method for decoding picture data encoded with a block consisting in a 
two-dimensional array of plural pixels as an encoding unit according to the present invention comprises 
detecting a flag provided at a portion of a header for the picture data for discriminating if the picture data 
have been encoded on the field-by-field basis, and decoding the picture data based on the flag on the field- 
75 by-field basis. 

According to a fourth picture data decoding method according to the present invention, the picture data 
in the third picture data decoding method has a hierarchical structure, and the flag is detected from a 
header of a predetermined hierarchical layer. 

A fifth picture data decoding method for decoding picture data encoded with a block consisting in a 
20 two-dimensional array of plural pixels as an encoding unit according to the present invention comprises 
detecting a flag provided at a portion of a header for the picture data for discriminating if the picture data 
have been encoded on the frame-by-frame basis, and decoding the picture data based on the flag on the 
frame-by-frame basis. 



According to a sixth picture data decoding method according to the present invention, the picture data 



25 in the fifth picture data decoding method has a hierarchical structure, and the flag is detected from a header 
of a predetermined hierarchical structure of the picture data. 

A first picture data encoding device for encoding picture signals with a block consisting in a two- 
dimensional array of plural pixels as an encoding unit according to the present invention comprises decision 
means for deciding if encoding of the picture signals is to be executed on the field-by-field basis or on the 

30 frame-by-frame basts, encoding means for encoding the picture signals on the field-by-field basis or on the 
frame-by-frame basis, depending on the results of decision by the decision means, for generating encoded 
picture data, and appending means for appending discrimination data to the encoded picture data based on 
the results of decision, the discrimination data indicating if the encoded picture data have been encoded on 
the field-by-field basis or on the frame-by-frame basis. 

35 With the second picture data encoding device according to the present invention, the appending means 
in the first picture data encoding device include a variable length encoding circuit. 

A third picture data encoding device according to the present invention further comprises, in the first 
picture data encoding device, motion vector detecting means for detecting the motion vector between first 
and second fields of a current frame to be encoded, the decision means executing decision based on the 

40 motion vector from the motion vector detecting means. 

A fourth picture data encoding device for executing block-based encoding of picture signals consisting 
in an interlaced two-dimensional array of pixels for generating encoded picture data having a hierarchical 
structure, according to the present invention, comprises motion vector detecting means for detecting the 
motion vector between first and second fields of a current frame of the picture signals to be encoded, from 

45 one macro-block to another, decision means for deciding if encoding of the picture signals is to be 
executed on the field-by-field basts or on the frame-by-frame basis, based on the magnitude of a median of 
the motion vector from the motion vector detecting means, as found over a predetermined hierarchical 
layer, encoding means for encoding the picture signals on the field-by-field basis or on the frame-by-frame 
basis, based on the results of decision from the decision means, and variable length coding means for 

50 variable length encoding the encoded picture data and discriminating data indicating that the encoded 
picture data have been encoded on the field-by-field basis or on the frame-by-frame basis, based on the 
results of decision from the decision means, and for causing said discriminating data to be appended to a 
header of a predetermined hierarchical layer of the picture data. 



A first picture data decoding device for decoding picture data encoded with a block consisting of a two- 



55 dimensional array of plural pixels as an encoding unit according to the present invention comprises 
detecting means for detecting a flag provided at a portion of a predetermined hierarchical layer of the 
picture data for indicating whether the picture contained in the hierarchical layer has been encoded on the 
field-by-field basis or on the frame-by-frame basis, and decision means for deciding, based on the flag from 
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the detecting means, whether or not decoding of the picture data is possible. 

A second picture data decoding device according to the present invention comprises, in the first picture 
data decoding device, display means for displaying the results of decision from the decision means. 

A third picture data decoding device according to the present invention comprises, in the first picture 
5 data decoding device, a variable length encoding circuit whereby the flag may be discriminated. 

A fourth picture data decoding device for decoding picture data encoded with a block consisting in a 
two-dimensional array of plural pixels as an encoding unit according to the present invention comprises 
detecting means for detecting a flag provided at a portion of a predetermined hierarchical layer of the 
picture data for indicating whether the picture contained in the hierarchical layer has been encoded on the 
w field-by-field basis or on the frame-by-frame basis, and decoding means for decoding the picture data by 
selecting, for each of hierarchical layers, one of field-based decoding or frame-based decoding depending 
on the flag from the detecting means. 

A fifth picture data decoding device according to the present invention comprises, in the fourth picture 
data decoding device, a variable length encoding circuit whereby the flag may be discriminated. 
75 A picture recording medium according to the present invention has recorded thereon encoded 
interlaced picture data encoded on the field-by-field basis or on the frame-by-frame basis, and dis- 
criminating data provided at a header of a predetermined hierarchical layer for indicating whether the 
encoded picture data have been encoded on the field-by-field basis or on the frame-by-frame basis. 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig.1 shows the relation between pictures in MPEG. 
Fig.2 shows the construction of a video frame in MPEG. 
Fig. 3 shows a concrete example of a picture having a moving object. 
25 Fig.4 shows a picture blurred in the shape of a comb. 

Fig.5 shows a concrete example of field-by-field coding/encoding. 
Fig.6 shows another concrete example of field-by-field coding/encoding. 
Fig. 7 shows a concrete example of frame-by-frame coding/encoding. 

Fig.8 shows a concrete method for motion prediction for the field-by-field encoding/decoding shown in 
30 Fig.5. 

Fig. 9 shows a concrete method for motion prediction for the field-by-field encoding/decoding shown in 
Fig.6. 

Fig. 10 shows a concrete method for motion prediction for the frame-by-frame encoding/decoding shown 
in Fig. 7. 

35 Fig. 11 shows a typical block construction in a macro-block for the field-by-field encoding/decoding. 

Fig. 12 shows a typical block construction in a macro-block for the frame-by-frame encoding/decoding. 

Fig. 13 shows a typical concrete construction of a buffer memory of a picture data encoding device 
according to the present invention. 

Fig. 14 shows a typical concrete construction of a buffer memory for the picture data encoding device 
40 shown in Fig. 13. 

Fig. 15 shows a method showing another concrete motion prediction for the field-by-field 
encoding/decoding shown in Fig.5. 

Fig. 16 shows a method showing another concrete motion prediction for the field-by-field 
encoding/decoding shown in Fig.6. 
45 Fig. 17 shows an example of concrete combination of frame-by-frame encoding/decoding and field-by- 
field encoding/decoding. 

Fig, 18 shows a method for concrete motion prediction of a P-picture in the encoding/decoding shown in 
Fig. 17. 

Fig. 19 shows a method for concrete motion prediction of a B-picture in the encoding/decoding shown in 
so Fig. 17. 

Fig. 20 shows another example of concrete combination of frame-by-frame encoding/decoding and field- 
by-field encoding/decoding. 

Fig.21 shows a method for concrete motion prediction of a P-picture in the encoding/decoding shown in 
Fig.20. 

55 Fig.22 shows a method for concrete motion prediction of a B-picture in the encoding/decoding shown in 
Fig.20. 

Fig.23 is a block diagram showing a concrete circuit construction for a picture data encoding device 
according to the present invention. 
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Fig. 24 shows the relation of pictures entered to the picture data encoding device shown in Fig.23. 

Fig.25 is a flow chart illustrating an algorithm of an encoding system decision circuit constituting the 
picture data encoding device shown in Fig.23. 

Fig. 26 shows a concrete format of a header od encoded picture data. 
5 Fig.27 is a block diagram showing a concrete circuit construction for a picture data decoding device 

according to the present invention. 

Fig. 28 is a block diagram showing a concrete circuit construction of an inverse VLC circuit constituting 
the picture data decoding device shown in Fig.27. 

Fig. 29 is a flow chart illustrating the operation of the picture data decoding device according to the 
w present invention. 

Fig.30 is a flow chart illustrating the operation of the picture data decoding device according to the 
present invention. 

BEST MODE FOR CARRYING OUT THE INVENTION 

75 

By referring to the drawings, concrete embodiments of the present invention will be explained in detail. 

1. Picture Data Encoding method/Picture Data Decoding Method 

20 The field-by-field and frame-by-frame encoding/decoding operations according to the present invention 

will be explained. 

If the picture shown in Fig.1 is a field-by-field picture, it may be represented as shown in Fig. 5, if its 
field-based construction is taken into account. In Fig. 5, an upper row denotes a first field, such as an odd- 
numbered field, and a lower row a second field, such as an even-numbered field. Two field temporally 

25 adjacent each other at an interval of 1/60 sec make up a frame. With the field-by-field encoding/decoding 
operation, each picture is encoded/decoded on the field-by-field basis. 

A concrete example in which a constructional pattern of the l-picture (intra-coded picture) / P-picture 
(predictive-coded picture) / B-picture(bidirectionally coded picture) in the GOP layer shown in Fig.2B is 
changed, is shown in Fig. 6. In Figs. 5 and 6, only the constructional pattern of the pictures in the GOP layer 

30 is changed, while Figs. 5 and 6 are common in carrying out the encoding/decoding operations on the field- 
by-field basis. Meanwhile, if the encoding type is the same between the first and the second fields, as in 
Fig.6, the first and the second fields may be encoded collectively, in which case the operation is the frame- 
by-frame encoding/decoding operation shown in Fig.7. 

A variety of motion prediction and compensation operations may be implemented for the 

35 encoding/decoding operations shown in Figs. 5, 6 and 7. Of these, simple concrete examples are shown in 
Figs.8, 9 and 10. In these figures, for example, in Figs.8 and 9, a thick broken-lined arrows from picture 12 
to picture 15 and from picture 13 to picture P6, indicate motion prediction to P-pictures. On the other hand, 
thin-lined arrows from picture 12 to picture BO in Figs.8 and 9 indicate motion prediction to the B-pictures. In 
Figs. 1 0A and 10B, solid-lined arrows indicate motion prediction of the frame-based macro-blocks, while 

40 broken-lined arrows indicate motion prediction of the field-based macro-blocks. 

With the field-by-field encoding/decoding, the P-picture, such as the P-picture P5 shown in Fig. 8, 
employs a picture 12, which is positioned temporally previously and already decoded, as a prediction 
picture, that is a reference picture for difference taking, while the picture P8 employs a picture P5, which is 
positioned temporally previously and already decoded, as a prediction picture. The picture P6 shown in 

45 Fig.9 employs a picture -P6 as a prediction picture, while the picture P7 employs a picture P6 as a 
prediction picture. The B-picture, such as the picture B4 shown in Fig.8, employs three pictures, that is 
picture 12, picture P5 and an interpolated picture of these pictures, as a prediction picture. The B-picture, 
such as the picture B4 shown in Fig.9, employs three pictures, that is picture 13, picture P6 and an 
interpolated picture produced from both of these pictures, as a prediction picture. 

so On the other hand, with frame-by-frame encoding/decoding, a frame made up of P-pictures or frames, 
such as pictures P6 and P7 shown in Fig. 1 0A, employs a frame made up of pictures 12 and 13, as a 
prediction picture, while a frame made up of pictures P10 and P11 employs a frame made up of pictures 
P6 and P7, as a prediction picture. On the other hand, a frame made up of B-pictures or frames, such as 
pictures B4 and B5 shown in Fig. 1 0B, employs three frames, namely a frame made up of pictures 12 and 13, 

55 which are positioned temporally previously and already decoded, a frame made up of pictures P6 and P7, 
and an interpolated picture produced from both of these pictures, as a prediction picture. 

As discussed in the foregoing, the field-by-field encoding/decoding operations and the frame-by-frame 
encoding/decoding operations are common in the encoding/decoding procedure. However, as will be 

8 

BNSDOCID: <EP 0573665A1_I_> 



EP 0 573 665 A1 



w 



15 



20 



25 



30 



35 



40 



45 



50 



55 



BNSDOCID: <EP. 



explained subsequently, they differ in the block constitution and motion prediction/compensation. 

(1) Block Constitution 

Since the first and second fields are collectively encoded and decoded with the frame-by-frame 
encoding/decoding operations, it is possible to combine the first and second fields into a sole block. On the 
other hand, with the field-by-field processing, a block may be constituted by any one of these fields. 

(2) Motion Prediction/Compensation 

With frame-by-frame encoding/decoding operations, the encoding/decoding operations are performed 
with the first and second fields combined together, so that motion prediction towards the second field 
belonging to one and the same frame is not employed. However, with field-by-field processing, motion 
prediction from the first field to the second field is employed. 

Details of the above paragraphs (1) Block Constitution and (2) Motion Prediction/Compensation are 
explained. 

(1) Block Constitution 

Fig. 11 shows the constitution of inner blocks of the macro-block in the field-by-field encoding/decoding 
operations. As shown in Fig. 1 1 , with the field-by-field encoding/decoding operations, the field-by-field 
macro-block is constituted solely by the first field or by the second field. 

On the other hand, Fig. 12 shows the constitution of inner blocks of the macro-block in the framed-by- 
frame encoding/decoding operations. With the framed-by-frame encoding/decoding operations, a frame-by- 
frame macro-block shown in Fig.12C may be employed in addition to the field-by-field macro-blocks shown 
in Figs.12A and 12B. That is, with the field-by-field macro-block, it is possible to divide a macro-block into 
upper and lower two blocks, with the upper two blocks being constituted solely by the first fields and the 
lower two blocks being constituted solely by the second fields, in addition to the first and second fields of 
the macro-block construction which are the same as in the field-by-field encoding/decoding operations 
shown in Fig. 1 1 . On the other hand, the frame-by-frame macro-block is constituted by first and second 
fields, as shown in Fig.12C. 

In this manner, with the frame-by-frame encoding/decoding operations, a frame-by-frame macro-block 
may be employed in addition to the field-by-fieid macro-block in the field-by-field encoding/decoding 
operations. 

Meanwhile, a switching between the field-by-field macro-block and the frame-by-frame macro-block as 
described in the foregoing may be realized by controlling readout addresses at the time of reading out 
blocks from buffer memories 7 and 8 based on the discrimination information for discrimination between the 
field-by-field encoding and the frame-by-frame encoding, as determined by an encoding system decision 
circuit 21 (Fig. 23) of the picture data encoding device as later explained. With a picture data decoding 
device as later explained, such switching may also be realized by detecting a flag recorded or superposed 
in an encoded bit stream received by a picture data encoding device etc. and deciding whether the 
encoding system is a field-by-field encoding system or a frame-by-frame encoding system, based on the 
detected flag, by an inverse variable length coding circuit 31 (Fig.27), and transmitting the corresponding 
information to motion compensating circuits 42, 43 etc. for controlling the readout addresses of the buffer 
memories 37, 38. 

That is, the buffer memories 7, 8, 37, 38 are constituted by memories each having a storage capacity of 
480 x 720 pixels, as shown in Figs. 13 and 14. If the encoding system is designed on the frame-by-frame 
basis, picture data are stored on the frame-by-frame basis and, if the encoding system is designed on the 
field-by-field basis, picture data are stored on the field-by-field basis, as shown in Fig. 13. Meanwhile, in 
Fig. 14, two fields need not be temporally contiguous to each other. Although the buffer memory is equal in 
capacity to a frame, there is no limitation tojhe memory capacity, and may be larger in capacity than the 
frame. Thus the buffer memory may be designed to store plural frames. In addition, although two buffer 
memories are employed in the block diagrams of Figs.23 and 27 for achieving matching to the 
encoding/decoding operations, there is no necessity of employing two buffer memories which may be 
combined into a sole buffer memory. 
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(2) Motion Prediction/Compensation 

With the field-by-field encoding/decoding operations, motion prediction from a first field to a second 
field of one and the same frame, such as prediction from picture 12 to picture B3 as shown in Fig.8 or 
5 prediction from picture P6 to picture P7 shown in Fig. 9, may be employed in effecting motion 
prediction/compensation. 

However, with frame-based encoding/decoding, since two fields are encoded/decoded collectively, as 
shown in Fig. 7, motion prediction from a first field to a second field belonging to the same frame as the first 
field is not employed. 

w As discussed in the foregoing, since the motion prediction of the field-by-field encoding/decoding 
operation makes use of the motion prediction from the first field to the second field of one and the same 
frame, the minimum distance between the pictures to be motion-predicted is diminished such that motion 
prediction comprises motion prediction of the frame-by-frame encoding/decoding operations. Although the 
motion prediction of the frame-based macro-block is shown in the above-described concrete embodiment, 

75 the same motion prediction is used for two fields within the macro-block so that two motion predictive 
operations of the field-based macro-blocks may be used in substitution. Besides, the frame-by-frame motion 
prediction is not the motion prediction indispensable to the frame-by-frame encoding/decoding operations, 
and only the field-by-field motion prediction suffices. 

In this manner, with the encoding/decoding method for pictures produced by interlaced scanning, 

20 according to the present invention, the encoding/decoding operations by both the field-by-field 
encoding/decoding method and the frame-by-frame encoding method are possible by associating the block 
constitutions and the method for controlling the motion prediction with the two encoding/decoding oper- 
ations. 

In such case, it is necessary to transmit to the picture data decoding device data indicating which of the 
25 field-by-field encoding operation and the frame-by-frame encoding operations has been carried out, and in 
which range the encoding operation has been carried out. 

To this end, according to the present invention, a flag indicating whether a range of an encoded picture 
has been processed on the field-by-field basis or on the frame-by-frame basis is provided at a portion of an 
encoded bit stream, that is encoded picture data. Meanwhile, this range means, for example, a sequence, 
30 GOP or a picture. Concretely, with the picture data encoding device, discrimination data for discriminating 
whether a range of a picture has been encoded on the field-by-field basis or on the frame-by-frame basis is 
set or superposed at a predetermined position of the encoded bit stream. The picture data decoding device 
deciphers such predetermined position of the encoded bit stream by the inverse variable length encoding 
circuit 31 as described above for determining the type of the unit of the decoding operation to perform a 
35 decoding operation accordingly for picture reproduction. 

It should be noted that the motion prediction in the field-based and frame-based encoding/decoding 
operations is not limited to the concrete embodiment shown in Figs.8 to 10. For example, in the frame- 
based encoding/decoding operations employing the motion prediction shown in Figs. 15 and 16, switching 
may be made for each hierarchical layer of the picture and the frame-based encoding/decoding operations. 
40 Specifically, Fig.lSA shows a concrete example different from the P-ptcture predicting method for field- 
by-field encoding/decoding operations, shown in Fig. 8, in the constructional pattern of the l/P/B picture in 
the GOP layer shown in Fig. 5. Fig.15B shows a concrete example different from the B-picture predictive 
method of the field-by-field encoding/decoding operations. That is, a picture PS is used in the concrete 
example of Fig.8 as a prediction picture for picture P8, white a picture such as a picture 12 may also be 
45 employed as shown in Fig.15A. On the other hand, while three pictures, namely the picture 12, picture P5 
and an interpolated picture of these two pictures, are used in the concrete example of Fig.8 as a prediction 
picture for picture B4, pictures 12, P5, P8, P1 1 and interpolated pictures of these pictures, may also bee 
employed, as shown in Fig.15B. 

Fig.l6A shows a concrete example different from the predictive method for the B-picture in the field- 
so based encoding/decoding operations shown in Fig.9, while Fig.16B shows a concrete example different from 
the predictive method for the B-picture in the., field-based encoding/decoding operations shown in Fig.9. 
That is, while picture 13 is employed in the concrete example shown in Fig.9. picture 12, for example, may 
also be employed, as shown in Fig.16A. Besides, while three pictures, namely pictures 13 and P6 and an 
interpolated picture of these two pictures, are employed in the concrete example of Fig.9 as a prediction 
55 picture for picture B4, pictures 12, 13, P6, P7 and interpolated pictures of these pictures, may also be 
employed, as shown in Fig.16B. 

In addition, the field-based encoding/decoding operations may also be combined with the frame-based 
encoding/decoding operations. 
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Figs. 17 and 20 illustrate concrete examples in which a plurality of pictures are encoded/decoded on the 
frame-by-frame basis and next following pictures are subsequently encoded/decoded on the field-by-field 
basis. Fig. 17 illustrates a combination of the frame-based encoding/decoding operations shown in Fig. 7 and 
the field-based encoding/decoding operations shown in Fig.5 and Fig.20 illustrates a combination of the 
5 frame-based encoding/decoding operations shown in Fig.7 and the field-based encoding/decoding oper- 
ations shown in Fig.6. 

In Fig. 17, a frame made up of pictures P6 and P7 may employ a frame made up of pictures 12 and 13 
as a prediction picture, as shown in Fig. 18, while picture P10 may employ picture P6, for example, as a 
predictive picture. On the other hand, a frame made up of pictures B4 and B5 may employ a frame made 
w up of pictures 12 and 13, a frame made up of pictures P6 and P7 and interpolated pictures of these frames, 
as shown in Fig. 19, while picture P8 may employ pictures P6, P7, P10 and interpolated pictures of these 
pictures. 

Next, in Fig.20, a frame made up of pictures P6 and P7 may employ a frame made up of pictures 12 
and 13, as a prediction picture, while a picture P10, for example, may employ picture P6, for example, as a 
15 prediction picture, as shown in Fig. 21. On the other hand, a frame made up of pictures B4 and B5 may 
employ a frame made up of pictures 12 and 13, a frame made up of pictures P6 and P7 and interpolated 
pictures of these frames, as prediction picture, as shown in Fig.22, while picture B8, for example, may 
employ pictures P6, P7, P10, P1 1 and interpolated pictures of these pictures, as prediction picture, as also 
shown in Fig.22. 

20 In this manner, as shown in Figs. 17 to 22, frame-based encoding/decoding operations may be 
combined with field-based encoding/decoding operations without any inconveniences. In other words, it is 
possible with the picture data encoding method and picture data decoding method according to the present 
invention to achieve efficient encoding for pictures with only small motion, pictures replete with motion and 
mixed pictures of these pictures, by switching from frame-based encoding/decoding operations to field- 

25 based encoding/decoding operations and vice versa when the pictures are produced as a result of 
interlaced scanning. 

2. Picture Data Encoding Device 

30 Ftg.23 is a block diagram showing a concrete circuit construction of a picture data encoding device 

according to the present invention. 

As shown in Fig.23, the picture data encoding device (encoder) comprises a local decoding circuit 

made up of an inverse quantization circuit 2 to gate 17, having the same circuit arrangement as that of a 

picture data decoding device as later explained. 
35 When picture data of a picture (field or frame) is entered at terminal 1, these picture data are stored 

once in buffer memory 18. Specifically, picture data are entered in the sequence of 10, B1, B2, P3, •** as 

shown in Fig.24A, and re-arrayed in the sequence in which the picture data are encoded by the encoder, as 

shown in Fig.24B. Motion prediction as shown in Fig.1 is carried out between the thus re-arrayed pictures. 

The input pictures 10, B1, B2, P3, • • • are shown as fields in Figs. 5 and 6, while they are shown as frames 
40 in Fig.7. 

The pictures thus re-arrayed are employed for detecting a motion vector by a motion vector detection 
circuit 19. Based on the previously encoded picture(s), the motion vector detection circuit 19 detects the 
motion vector required for generating the picture(s) for prediction. That is, a forward picture and a backward 
picture are held by the buffer memory 18 and motion vector is detected between these pictures and a 

45 current reference picture. For detecting the motion vector, such a motion vector is employed which has a 
minimum sum of absolute values of the differences between pictures on the macro-block basis. 

The motion vector and the sums of the absolute values of the differences between pictures on the 
macro-block basis are transmitted to an encoding system decision circuit 21. By employing an algorithm, 
which will be explained later, the encoding system decision circuit 21 decides whether the encoding system 

so of a picture of a certain hierarchical layer is a field-based encoding system or a frame-based encoding 
system. The information concerning the encoding system, that is whether the encoding system is a field- 
based system or a frame-based system, and the motion vector, are transmitted to motion compensation 
circuits 12, 13 and to variable length encoding circuit 25 so as to be used for controlling the buffer- 
memories 7 and 8, while being transmitted to the picture data decoding device as later explained. The 

55 information concerning the encoding system is transmitted to a controlling circuit 16 which outputs control 
signals controlling the encoding system to gates 5, 17 and changeover switches 6, 9, 10 and 15. 

In addition, the motion vector and the sums of the absolute values of the differences between pictures 
on the macro-block basis are transmitted to an intra-picture / predictive / backward / bidirectional prediction 
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decision circuit 20, referred to herein as a prediction decision circuit. Based on these values, the prediction 
decision circuit 20 decides the predictive mode for the reference macro-block. 

The predictive mode is transmitted to the control circuit 156. Based on the predictive mode, the control 
circuit 16 outputs a control signal to the gates 5 and 17 for effecting switching between intra-picture / 
5 predictive / backward / bidirectional prediction. The control circuit 16 transmits the motion vector associated 
with the selected prediction mode to buffer memories 7, 8 for generating the prediction picture. More 
concretely, if the mode is the intra-picture encoding mode, the input picture itself is generated, whereas, if 
the mode is the predictive / backward / bidirectional predictive mode, respective prediction pictures are 
generated. The operation of the gates 5, 17 and changeover switches 6, 9, 10 and 15 is the same as that of 
w the changeover switches 36, 39, 40 and 45, so that the corresponding operation is omitted for simplicity. 

The predictive pictures from buffer memories 7, 8 are transmitted to a difference unit 22 generating 
difference data between the predictive picture and the current picture. The difference data are supplied to a 
discrete cosine transform (DCT) circuit 23. 

The DCT circuit 23 discrete cosine transforms the input picture data or difference data for each block 
is by taking advantage of the two-dimensional correlation of the picture signals to transmit the resulting DCT 
data to quantization circuit 24. 

The quantization circuit 24 quantizes the DCT data with quantization step size (scale) determined for 
each macro-block or for each slice to process the results by so-called zigzag scanning. The quantization 
circuit then transmits the resulting quantized data to a variable length coding circuit 25 and to a 
20 dequantization circuit 2. 

The quantization step size, employed for quantization, is selected to a value of not causing the failure 
(overflow) of the transmission buffer memory 26 by feeding back the residual contents of the transmission 
buffer memory 26. The quantization step size data as well as the quantization data is supplied to VLC 
circuit 25 and to dequantization circuit 2. 
25 The VLC circuit 25 proceeds to process the information including the quantization data, quantization 
step size, predictive mode, motion vector or the encoding system by variable length encoding, appends the 
coding system information, that is the information concerning whether the encoding system is the field-by- 
field encoding system or the frame-by-frame encoding system, to a header of the predetermined hierarchi- 
cal layer, and transmits the resulting data a sth transmission data to transmission buffer memory 26. 
30 The transmission buffer memory 26 stores the transmission data temporarily in a memory and 

subsequently transmits the stored data as a bit stream at a predetermined timing. Besides, the transmission 
buffer memory 26 feeds back the macro-block based quantization control signals to the quantization circuit 
24 depending on the quantity of residual data in the memory to control the quantization step size. In this 
manner, the transmission buffer memory 26 controls the data volume gene rated as the bit stream to 
35 maintain a moderate amount of data, that is the data volume which will not produce an underflow or an 
overflow, in the memory. 

For example, if the residual data volume in buffer memory 26 is increased to an allowable upper limit, 
the transmission buffer memory increases the quantization step size of the quantization circuit 24 by 
quantization control signals for lowering the data volume of the quantized data. 

40 Conversely, if the residual data volume in buffer memory 26 is decreased up to an allowable lower limit 
value, the data volume of the quantization data is increased by decreasing the quantization step size of the 
quantization circuit 24 by the quantization control signals. 

It will be seen from above that the bit stream from the transmission buffer memory 26, adjusted in its 
data volume, is multiplexed with encoded audio signals and synchronization signals. The multiplexed 

45 signals are added to with error correction code data and modulated in a predetermined manner before 
being recorded as pits of projections and recesses on a master disc by means of a laser beam. A stamper 
is produced from the master disc and a large number of duplicated discs, for example, picture recording 
media, such as optical discs, from the stamper. Besides, the bit stream is transmitted over a transmission 
channel to a picture data decoding unit as later explained. Meanwhile, the picture recording medium is not 

50 limited to the optical disc, but may for example be a magnetic tape. 

On the other hand, output data from the inverse DCT circuit 3 is added to with the predictive picture by 
addition circuit 4 to effect local decoding. The operation of the local decoding is the same as that of a 
picture decoding device as later explained and hence the corresponding explanation is not made for 
simplicity. 

55 It is noted that the picture constructing pattern is not limited to that shown in Fig. 3 and differs with 

different encoding sequences. Concretely, there are a number of variations in the encoding processing 
sequence of P-pictures and B-pictures temporally sandwiched between the P-pictures. However, these may 
be dealt with by simply changing the processing sequence by changing the control for buffer memories 7, 
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8. 

The concrete algorithm for a encoding system decision circuit 21 is hereinafter explained by referring to 
a flow chart shown in Fig.25. 

The encoding system decision circuit 21 selects the encoding system by taking advantage of the 
5 motion vector from the first frame, e.g. an odd field, to the second field, such as an even field. 

Concretely, encoding system decision circuit 21 finds the motion vector at step ST1 for all of the 
macro-blocks in a frame to be encoded before proceeding to step ST2. 

At step ST2, encoding system decision circuit 21 finds a median value of each of the horizontal 
components (x) and vertical components (y) of the motion vector, before proceeding to step ST3. 
io Concretely, the median value of the horizontal components is found in the following manner. First, the 
horizontal components of the motion vector are arrayed in the order of the falling powers, and the value of 
the center data is adopted as a median Mv x of the horizontal components. The median value Mv y is found 
in the similar manner. 

At step ST3 encoding system decision circuit 21 finds the size R of the vector MV found at step ST2 as 
/5 a parameter indicating the magnitude of the motion of the entire screen, because the vector MV is the 
parameter indicating the magnitude of the entire screen. The decision circuit then proceeds to step ST4. 
The size R is found by the following formula 1 

R = |MVo = sqrt(Mv x 2 + Mv y 2 ) (1) 

20 

At step ST4, encoding system decision circuit 21 causes the encoding system to be switched by the 
size R as found at step ST3. Since the field-by-field encoding system (encoding operation) is more 
favorable with pictures with fast motion, and the frame-by-frame encoding system (encoding operation) is 
more favorable with pictures with little motion, the encoding system decision circuit 21 proceeds to step 

25 ST5 if the size R is not more than a predetermined threshold value TH to select the frame-based encoding 
system. Otherwise, the decision circuit proceeds to step ST6 to select the field-based encoding system. 

It will be seen from above that the picture data encoding device according to the present invention 
decides whether the encoding system is to be performed on the field-by-field basis or on the frame-by- 
frame basis, depending on the motion occurring in the picture, more specifically, on the motion vector 

30 between the first and second fields of the same frame or on the size of the median value of the motion 
vector, so that efficient encoding may be achieved not only with the picture having abundant motion or little 
motion but also with the picture having both abundant motion and little motion. 

3. Picture Data Format 

35 

Concrete examples of the bit stream outputted from the present picture data encoding device, that is of 
the picture data format, are hereinafter explained. 

Fig.26A shows an example in which a discrimination data for discriminating whether the encoding has 
been performed on the frame-by-frame basis or on the field-by-field basis (the information concerning the 

40 encoding system) is appended as flag, as shown in Fig.26A. In the video sequence layer, start code, 
horizontal size, vertical size etc. are recorded with a predetermined number of bits, indicated by numerals in 
the figures, as shown in Fig.26A. In the present embodiment, the discrimination data for discriminating 
whether the encoding has been performed on the field-by-field basis or on the frame-by-frame basis, is 
appended after the frame frequency as a 1-bit flag. The flag may also be appended at some other location. 

45 The above flag may also be added to a header of the GOP layer, as shown in Fig.26B. In the present 

instance, discrimination data are added following the time code as a 1-bit flag. The flag may also be added 
at any other location. 

Fig.26 shows an instance in which the flag is added to the MPEG standard. Such flag may also be 
written in extension regions of each layer as prescribed by MPEG. For the video sequence layer, for 
so example, it may be written in the extension region (sequence extension bytes) or in user data. Concretely, 
the flag may be added to the extension regjon of the picture layer according to the MPEG standard, as 
shown in Fig.26C. 2-bit flags are used for indicating the encoding system. The 2-bit flags denote the 
following contents: 

00: A picture encoded on the frame-by-frame basis. 
55 01 : A first field of a picture encoded on the field-by-field basis. 

10: A second field of a picture encoded on the field-by-field basis. 
1 1 : Spare. 
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4. Picture Data Encoding Device 

Fig.27 is a block diagram showing a concrete circuit arrangement of a picture data decoder according 
to the present invention. 

5 An inverse variable length coding circuit (inverse VLC circuit) 31 encodes the bit stream from the 

picture data encoder shown in Fig. 23 or the bit stream obtained on reproducing a picture recording 
medium, such as an optical disc, by inverse variable length encoding, and outputs the resulting data to a 
dequantization circuit 32. Simultaneously, the inverse VLC circuit 31 deciphers data written by superposition 
on the picture data during encoding, such as motion vector, quantization width (quantization step size) or 

w encoding information. 

Above all, inverse VLC circuit 31 deciphers the flags appended to headers of the video sequence layer, 
GOP layer or the picture layer to obtain the information as to whether the decoding is to be made on the 
frame-by-frame basis or on the field-by-field basis. Such information is supplied to a control circuit 46 which 
then generates control signals for frame-based processing or field-based processing. Specifically, the 

75 control circuit 46 is responsive to the output of inverse VLC circuit 31 to generate a variety of control 
signals for changing over gates 35 and 47 and fixed contacts of changeover switches 36, 39, 40 and 45. 

That is, if, in the case of frame-based processing, each picture is made up of 480 lines each consisting 
of 720 pixels, and each macro-btock consists of 16x16 pixels, picture processing is completed by 1350 
macro-blocks, and a corresponding control signal is generated for processing the next picture. On the other 

20 hand, in the case of field-based processing, picture processing is completed by 675 macro-blocks and a 
corresponding control signal is generated for processing the next picture. Besides, frame-based or field- 
based decoding is carried out by controlling the scheduling of buffer memories 37, 38. 

On the other hand, the control signal indicating if the decoding is to be frame-based or field-based, 
produced by the inverse VLC circuit 31, is also supplied to motion compensation circuits 42, 43, and a 

25 frame-based or field-based decoding is carried out by the motion compensation circuits 42, 43 controlling 
addresses of the buffer memories 37, 38, as discussed in detail hereinbelow. 

The dequantization circuit 32 inversely scans and dequantizes data processed by inverse VLC to output 
the resulting data to an inverse DCT circuit 33. The inverse DCT circuit 33 inversely discrete cosine 
transforms input data to output the resulting data to an additive node 34. The additive node 34 is supplied 

30 via gate 47 with predictive picture data as selected by switching of the changeover switch 45. The 
predictive picture data is summed to output data of the inverse DCT circuit 33 to generate decoded picture 
data. 

If an output of the additive node 34 is an l-picture or a P-picture, gate 35 is opened, and decoded 
picture data are supplied via changeover switch 36 to buffer memories 37 or 38 so as to be stored therein. 

35 Specifically, if the output of the additive node 34 is the l-picture or the P-picture, changeover switches 

39, 40 are changed over to fixed contacts a. The changeover switch 36 is alternately changed over to 
contacts a and b so that the picture (l-picture or the P-picture) outputted from the additive node 34 is 
alternately stored in the buffer memories 37, 38. 

If picture data arrayed in the sequence of pictures 10, B1 , B2, P3, B4, B5, P6, B7, B8, P9, as shown at 

40 A in Fig.24, are processed by picture data encoder in the sequence of pictures 10, P3, B1, B2, P6, B4, B5, 
P9, B7, B8, as shown at B in Fig.24, the picture data are entered to inverse VLC circuit 31 in the latter 
sequence of pictures, as shown at D in Fig.24. 

As a result thereof, if decoded data of picture 10 are stored in buffer memory 37, as shown at E in 
Fig.24, decoded data of picture P3 are stored in buffer memory 38, as shown at F in Fig.24. Besides, data 

45 of picture 10 of buffer memory 37 are updated to data of picture P6, while data of picture P3 of buffer 
memory 38 are updated to data of picture P9, as shown at E and F in Fig.24. 

When data of pictures B1 or B2 are entered to additive node 34 from inverse DCT circuit 33 in the 
wake of pictures 10 and P3, data of picture 10 stored in buffer memory 37 are motion-compensated in 
motion compensation circuit 42 in accordance with the motion vector before being supplied to an 

so interpolating circuit 44. On the other hand, data of picture P3 stored in buffer memory 38 are motion- 
compensated in motion compensation circuit 43Un accordance with the motion vector before being supplied 
to interpolating circuit 44. The interpolating circuit 44 combines input data from the motion compensation 
circuits 42, 43 at a predetermined ratio in accordance with data entered from the inverse VLC circuit 31. 
The combined data is selected by changeover switch 45 so as to be supplied via its contact b and gate 47 

55 to additive node 34. The additive node 34 sums data from inverse VLC circuit 33 and data as selected by 
changeover circuit 45 for decoding the pictures B1 or B2. 

If the pictures B1 or B2 are decoded only from the previous picture 10, changeover switch 45 is 
changed over to its contact a, whereas, if the pictures B1 or B2 are decoded only from the posterior picture 
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P3, changeover switch 45 is changed over to its contact c. In either cases, data of the pictures 10 or P3 are 
supplied to additive node 34. 

The changeover switch 39 is adapted for being switched n a reverse phase to changeover switch 36. 
That is, if changeover switch 36 is changed over to its contact a or b, changeover switch 39 is changed 

5 over to its contact b or a, respectively. The result is that, if, after picture 10 is stored in buffer memory 37, 
changeover switch 36 is changed over to its contact b and picture P3 is stored in buffer memory 38, 
changeover switch 39 is changed over to its contact a, the changeover switch 40 being then changed over 
to its contact a, and the picture 10 is read out from buffer memory 37, as shown at g in Fig. 24, so as to be 
supplied via changeover switches 39, 40 to a display 41, where the reproduced picture is displayed. When 

w pictures B1 and B2 are outputted from additive node 34, changeover switch 40 is already changed over to 
its contact b, so that pictures B1 and B2 are supplied to display 41, as shown at G in Fig.24. The. 
changeover "switch 39 is then changed over to its contact b, while the changeover switch 39 is changed 
over to its contact a, so that the picture P3 already stored irT buffer memory 38 is read out and supplied to 
display 41. 

15 A concrete circuit arrangement of the inverse VLC circuit 31 is hereinafter explained. 

The inverse VLC circuit 31 includes a barrel shifter 31a and a code deciphering section 31b, as shown 
in Fig.28. Input code data are supplied by barrel shifter 31a to the code deciphering section 31b on the 16- 
or 32-bit basis. The code deciphering section 31b is constituted by a codetable or matching circuitry, not 
shown, for matching the input code data to the code data stored in the codetable, and outputting the data 
20 and its code length CL, based on the code type, in case of coincidence between the two code data. 

The data are supplied to other circuitry of the inverse VLC circuit, not shown, before being supplied to 
the above-mentioned control circuit 46, motion compensation circuit 43, etc. 

On the other hand, the code length CL is supplied to barrel shifter 31a as a shift quantity to be shifted 
next time. Barrel shifter 31a then outputs the next code data on the 16- aid 32-bit basis to the code 
25 deciphering section 31b in dependence upon the shift quantity. 

Consequently, the flag for indicating the frame-based processing or field-based processing is also 
written in the codetable as the header along with other code data. 

It will be seen from above that, with the picture data decoding device according to the present 
invention, picture data may be reproduced by detecting the flag provided in the portion of header for the 
30 video sequence layer, GOP layer or the picture layer which is adapted for indicating whether the picture 
data have been processed on the field-by-field basis or on the frame-by-frame basis, and by decoding the 
picture data in dependence upon the flag. 

Meanwhile, the picture data decoding device of the illustrated embodiment is able to execute decoding 
both the field-based picture data and the frame-based picture data. In case of a device in which only one of 
35 these picture data can be decoded, a decision may be given from the flag as to if the device is able to 
execute decoding of field-based picture data or frame-based picture data. 

Specifically, a decision circuit 51 for concluding if decoding is possible based on the flag supplied from 
inverse VLC circuit 31 and a display unit 52 for displaying the result of decision are provided, as shown in 
Fig.27. 

40 In the case of a picture data decoding device for decoding only field-based picture data, an operation is 
executed in accordance with a flowchart shown in Fig. 29, whereas, in the case of a picture data decoding 
device for decoding only frame-based picture data, an operation is executed in accordance with a flowchart 
shown in Fig. 29. 

That is, with the picture data decoding device for decoding only field-based picture data, decision 
45 circuit 51 enters a flag at step ST1, before proceeding to step ST2. 

At step ST2, decision circuit 51 checks to see if the flag indicates a frame-based processing. If the 
result is YES, decision circuit proceeds to step ST4 and, if otherwise, decision circuit 51 proceeds to step 
ST3. 

At step ST3, decision circuit 51 causes the display unit 52 to display that decoding is impossible, 
50 before terminating the program. 

At step ST4, decision circuit 51 causes the display unit 52 to display that decoding is possible, before 
terminating the program. Decoding is executed at step ST5. 

On the other hand, with the picture data decoding device for decoding only frame-based picture data, 
decision circuit 51 enters a flag at step ST1, before proceeding to step ST2. 
55 At step ST2, decision circuit 51 checks to see if the flag indicates a field-based processing. If the result 
is YES, decision circuit proceeds to step ST4 and, if otherwise, decision circuit 51 proceeds to step ST3. 

At step ST3, decision circuit 51 causes the display unit 52 to display that decoding is impossible, 
before terminating the program. 
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At step ST4, decision circuit 51 causes the display unit 52 to display that decoding is possible, before 
terminating the program. Decoding is executed at step ST5. 

In this manner, the user may easily grasp the reason the picture data cannot be reproduced by the 
device by checking the display on the display section 52. 
5 Tables 1 and 2 illustrate concrete examples of discrimination data useful in discriminating whether the 

encoding has been made on the field-by-field basis or on the frame-by-frame basis. The concrete examples 
shown therein correspond to specifications of picture layers in 25-Nov-92 Teat Model 3, Draft Revision 1, 
issued as N-paper on November 25, 1992 by ISO/ICE JTC1/SC29/WG1 1 . 
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A picture data encoding method for encoding interlaced picture signals, comprising deciding if 
encoding of said picture signals is to be executed on the field-by-field basis or on the frame-by-frame 
basis, 

encoding said picture signals on the field-by-field basis or on the frame-by-frame basis, depending 
on the results of decision, for generating encoded picture data, and 

appending discrimination data to said encoded picture data based on the results of decision, said 
discrimination data indicating if said encoded picture data have been encoded on the field-by-field 
basis or on the frame-by-frame basis. 



25 



The picture data encoding method as claimed in claim 1 wherein said encoded picture data has a 
hierarchical structure and wherein said discriminating data is provided at a portion of a header of a 
predetermined hierarchical layer of said encoded picture data. 

The picture data encoding method as claimed in claim 1 wherein the decision is executed based on a 
motion vector of each macro-block. 



30 



A picture data encoding method for encoding interlaced picture signals, comprising 

encoding said picture signals on the field-by-field basis for generating encoded picture data, and 
appending to said encoded picture data discrimination data indicating that said encoded picture data 
have been encoded on the field-by-field basis. 



35 



The picture data encoding method as claimed in claim 4 wherein said encoded picture data has a 
hierarchical structure and wherein said discriminating data is provided at a portion of a header of a 
predetermined hierarchical layer of said encoded picture data. 



40 



A picture data encoding method for encoding interlaced picture signals, comprising 

encoding said picture signals on the frame-by-frame basis for generating encoded picture data, and 
appending discrimination data indicating that said encoded picture data have been encoded on the 
frame-by-frame basis to said encoded picture data. 



45 



The picture data encoding method as claimed in claim 6 wherein said encoded picture data has a 
hierarchical structure and wherein said discriminating data is provided at a portion of a header of a 
predetermined hierarchical layer of said encoded picture data. 



50 



A picture data decoding method for decoding picture data encoded with a block consisting in a two- 
dimensional array of plural pixels as an encoding unit, comprising 

detecting a flag provided at a portion of a header for said picture data for discriminating if the 
picture data have been encoded on the field-by-field basis or on the frame-by-frame basis, and 

adaptively switching between field-baseci decoding and frame-based decoding based on said flag. 



55 



The picture data decoding method as claimed in claim 8 wherein said picture data has a hierarchical 
structure, said flag is detected from a header of a predetermined hierarchical layer of said picture data, 
and wherein switching is adaptively made between field-based decoding and frame-based decoding for 
each of predetermined hierarchical layers based on said flag. 
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10. A picture data decoding method for decoding picture data encoded with a block consisting in a two- 
dimensional array of plural pixels as an encoding unit, comprising 

detecting a flag provided at a portion of a header for said picture data for discriminating if the 
picture data have been encoded on the field-by-field basis, and 
5 decoding the picture data based on said flag on the field-by-field basis. 

11. The picture data decoding method as claimed in claim 10 wherein 
said picture data has a hierarchical structure, and wherein 
said flag is detected from a header of a predetermined hierarchical layer. 

10 

12. A picture data decoding method for decoding picture data encoded with a block consisting in a two- 
dimensional array of plural pixels as an encoding unit, comprising 

detecting a flag provided at a portion of a header for said picture data for discriminating if the 
picture data have been encoded on the frame-by-frame basis, and 
15 decoding the picture data based on said flag on the frame-by-frame basis. 

13. The picture data decoding method as claimed in claim 12 wherein 
said picture data has a hierarchical structure, and wherein 
said flag is detected from a header of a predetermined hierarchical layer. 

14. A picture data encoding device for encoding picture signals with a block consisting in a two- 
dimensional array of plural pixels as an encoding unit, comprising 

decision means for deciding if encoding of said picture signals is to be executed on the field-by- 
field basis or on the frame-by-frame basis, 

encoding means for encoding said picture signals on the field-by-fietd basis or on the frame-by- 
frame basis, depending on the results of decision by said decision means, for generating encoded 
picture data, 

appending means for appending discrimination data to said encoded picture data based on the 
results of decision, said discrimination data indicating if said encoded picture data have been encoded 
on the field-by-field basis or on the frame-by-frame basis. 

15. The picture data encoding device as claimed in claim 14 wherein said appending means include a 
variable length encoding circuit. 

35 16. The picture data encoding device as claimed in claim 14 further comprising motion vector detecting 
means for detecting a motion vector between first and second fields of a current frame to be encoded, 
said decision means executing said decision based on the motion vector from said motion vector 
detecting means. 

17. A picture data encoding device for executing block-based encoding of picture signals consisting in an 
interlaced two-dimensional array of pixels for generating encoded picture data having a hierarchical 
structure, comprising 

motion vector detecting means for detecting the motion vector between first and second fields of a 
current frame of said picture signals to be encoded, from one macro-block to another, 

decision means for deciding if encoding of said picture signals is to be executed on the field-by- 
field basis or on the frame-by-frame basts, based on the magnitude of a median of the motion vector 
from said motion vector detecting means, as found over a predetermined hierarchical layer, 

encoding means for encoding said picture signals on the field-by-field basis or on the frame-by- 
frame basis, based on the results of decision from said decision means, and 

variable length coding means for variable length encoding said encoded picture data and dis- 
criminating data indicating that said encoded picture data have been encoded on the field-by-field basis 
or on the frame-by-frame basis, based on the results of decision from said decision means, and for 
causing said discriminating data to be appended to a header of a predetermined hierarchical layer of 
said picture data. 

18. A picture data decoding device for decoding picture data encoded with a block consisting of a two- 
dimensional array of plural pixels as an encoding unit, comprising 

detecting means for detecting a flag provided at a portion of a predetermined hierarchical layer of 
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said picture data for indicating whether the picture contained in said hierarchical layer has been 
encoded on the field-by-field basis or on the frame-by-frame basis, and 

decision means for deciding, based on said flag from said detecting means, whether or not 
decoding of said picture data is possible. 

5 

19. The picture data decoding device as claimed in claim 18 further comprising display means for 
displaying the results of decision from said decision means. 

20. The picture data decoding device as claimed in claim 18 further comprising an inverse variable length 
w coding circuit, said flag being discriminated by said inverse variable length coding circuit. 

21. A picture data decoding device for decoding picture data encoded with a block consisting in a two- 
dimensional array of plural pixels as an encoding unit, comprising 

detecting means for detecting a flag provided at a portion of a predetermined hierarchical layer of 
15 said picture data for indicating whether the picture contained in said hierarchical layer has been 

encoded on the field-by-field basis or on the frame-by-frame basis, and 

decoding means for decoding said picture data by selecting, for each of hierarchical layers, one of 
field-based decoding or frame-based decoding depending on the flag from said detecting means. 

20 22. The picture data decoding device as claimed in claim 21 further comprising an inverse variable length 
coding circuit, said flag being discriminated by said inverse variable length coding circuit. 

23. A picture recording medium having recorded thereon encoded interlaced picture data encoded on the 
field-by-field basis or on the frame-by-frame basis in a hierarchical layer, and discriminating data 
25 provided at a header of a predetermined one of said hierarchical layers for indicating whether the 

encoded picture data have been encoded on the field-by-field basis or on the frame-by-frame basis. 
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